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Abstract 

Background: Similar to many developed countries, vaccination against human papillomavirus (HPV) is provided 
only to girls in New Zealand and coverage is relatively low (47% in school-aged girls for dose 3). Some jurisdictions 
have already extended HPV vaccination to school-aged boys. Thus, exploration of the cost-utility of adding boys' 
vaccination is relevant. We modeled the incremental health gain and costs for extending the current girls-only 
program to boys, intensifying the current girls-only program to achieve 73% coverage, and extension of the 
intensive program to boys. 

Methods: A Markov macro-simulation model, which accounted for herd immunity, was developed for an annual 
cohort of 12-year-olds in 201 1 and included the future health states of: cervical cancer, pre-cancer (CIN I to III), 
genital warts, and three other HPV-related cancers. In each state, health sector costs, including additional health 
costs from extra life, and quality-adjusted life-years (QALYs) were accumulated. The model included New Zealand 
data on cancer incidence and survival, and other cause mortality (all by sex, age, ethnicity and deprivation). 

Results: At an assumed local willingness-to-pay threshold of US$29,600, vaccination of 12-year-old boys to achieve 
the current coverage for girls would not be cost-effective, at US$61, 400/QALY gained (95% Ul $29,700 to $1 12,000; 
OECD purchasing power parities) compared to the current girls-only program, with an assumed vaccine cost of US 
$59 (NZ$1 13). This was dominated though by the intensified girls-only program; US$17,400/QALY gained (95% Ul: 
dominant to $46,100). Adding boys to this intensified program was also not cost-effective; US$128,000/QALY 
gained, 95% Ul: $61,900 to $247,000). 

Vaccination of boys was not found to be cost-effective, even for additional scenarios with very low vaccine or 
program administration costs - only when combined vaccine and administration costs were NZ$125 or lower per 
dose was vaccination of boys cost-effective. 

Conclusions: These results suggest that adding boys to the girls-only HPV vaccination program in New Zealand is 
highly unlikely to be cost-effective. In order for vaccination of males to become cost-effective in New Zealand, 
vaccine would need to be supplied at very low prices and administration costs would need to be minimised. 
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Background 

Most developed countries have now implemented vaccin- 
ation against human papillomavirus (HPV) infection of 
pre-adolescent girls. This development has been supported 
by cost-effectiveness analyses in over 40 countries that have 
almost universally concluded that vaccination of girls is 
cost-effective [1]. In low resource settings, the GAVI alli- 
ance has announced that it will co-finance the HPV vaccine 
in the poorest countries, with supplier-agreed vaccine 
prices of about US$5 per dose. In addition to the benefits 
to women of reduced cervical intra-epithelial neoplasia 
(CIN) and cervical cancer, HPV vaccination can reduce 
other cancers and diseases which impact both sexes, includ- 
ing anal and oropharyngeal cancers and genital warts. As 
such, some public health professionals and researchers pro- 
file the ethical debate of the exclusion of boys in a vaccin- 
ation program from which they could reap additional 
health benefits. In recent decades, data suggest that inci- 
dence rates for HPV-related anal and oropharynx cancer, 
affecting both sexes, have been increasing in many coun- 
tries, including the US [2], and Australia [3,4] and markedly 
in 50-69 year-old males in New Zealand [5]. Vaccinating 
males as well as females will confer more benefit than vac- 
cinating females only, but the extent of the incremental 
benefit will critically depend on coverage in females. Vac- 
cination also substantially decreases disease burden related 
to genital warts, as reported in Australia [6], Sweden [7], 
and New Zealand [8,9]. 

Health authorities, including the Advisory Committee for 
Immunization Practices for the US Centers for Disease 
Control and Prevention, have recommended the vaccin- 
ation of boys [10]. While vaccination of boys has been 
available through private health services in the US, 
Australia became the first country to offer publicly-funded 
HPV boys vaccination (quadrivalent vaccine Gardasil 8 ) in 
2013 [11], although the cost-effectiveness and equity benefit 
of this program has been criticized [12]. To date, cost- 
effectiveness analyses of the inclusion of boys into existing 
girls' programs have had varying results. HPV-related dis- 
ease may be reduced in males either through direct benefits 
to vaccinated males or herd immunity effects to unvaccin- 
ated males due to sexual contact with vaccinated females or 
males. The cost-effectiveness of adding boys to existing vac- 
cination programs depends on a number of model parame- 
ters and assumptions, including: the coverage achieved in 
females, since this will determine the predicted herd im- 
munity (e.g., in dynamic models) for heterosexual males de- 
rived from vaccinating girls [13]; the HPV-related burden 
of disease in males (which is lower than in females [1]); the 
proportion of HPV-related disease in men-who-have-sex- 
with-men (MSM; difficult to model for young cohorts and 
rarely explicitiy included in population models) [1]; the cost 
of the vaccine and administration; the vaccine efficacy and 
duration of protection; the number of diseases included in 



analyses, and the associated burden of those diseases in the 
setting of interest. 

When vaccine coverage is high (e.g., over 70%) in fe- 
males, modeling indicates that non-vaccinated hetero- 
sexual males would receive high levels of health benefits 
via herd immunity [13-15]. For example, in a dynamic 
Canadian heterosexual population model with a vaccin- 
ation coverage of 70% for 12-year-old girls and 0% of 
boys, HPV-16/18 overall population prevalence was re- 
duced by 64% [13]. Adding 70% coverage for boys to this 
program only decreased this HPV-16/18 prevalence by 
another 24%. Therefore additionally vaccinating boys, at 
higher coverage rates, was less cost-effective than in- 
creasing coverage for girls [13]. 

For lower vaccination coverage levels (e.g., <50%) one 
study found that increased coverage for females was more 
cost-effective than adding boys to a girls-only vaccination 
program, even if the intensified girls program incurred high 
costs of US$350 per additional girl vaccinated [16]. A re- 
cent review of HPV vaccination cost-effectiveness modeling 
concluded that increasing female coverage appears to be a 
better investment, but that vaccination of boys may be 
cost-effective when female coverage is less than 50% and it 
costs about US$400- 500 per vaccinated girl/boy [1]. 

Among MSM, herd immunity benefits are obviously 
lower for girls-only vaccination and depend in part on 
behavior patterns for non-exclusive MSM in the popula- 
tion. Targeted vaccination of MSM may be cost-effective 
in some settings (e.g., those with high HIV rates), par- 
ticularly at younger ages [17]. However, targeted HPV 
vaccination of a young cohort prior to HPV exposure of 
MSM is a considerable challenge for vaccination pro- 
grams to achieve (and we know of no settings where it 
has been effectively operationalized). 

Another important determinant of the cost-effectiveness 
is vaccine and associated administration costs. Many gov- 
ernments have negotiated vaccine prices with suppliers for 
large-scale public programs and these costs are often not 
readily available to the public (although vaccine prices per 
dose of about US$100 have been used in past studies [1]). 
Importantly, costs may continue to drop in developed 
countries and two-dose vaccination (which appear to be 
nearly as effective as three-dose regimens) may be increas- 
ingly introduced [18]. 

The goal of this research was to examine the cost- 
effectiveness of adding boys to a girls-only program in New 
Zealand. This study makes use of national, high-quality 
health and costing data and includes a number of health 
outcomes which affect both males and females. We mod- 
eled cost-effectiveness for two different coverage rates and 
also modeled a suite of scenarios for changes in vaccine 
and administration costs. Such scenarios may facilitate 
foward-thinking by policy-makers as vaccine prices con- 
tinue to decline. 
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Methods 

Model overview 

The study methods followed the Burden of Disease 
Epidemiology, Equity and Cost-Effectiveness Programme 
(BODE ) Protocol [19]. We adapted a previous Markov 
model on the cost-utility of girls-only HPV vaccination 
[20], to estimate quality-adjusted life years (QALYs) gained 
and net health system costs, for girls-only and girls and 
boys vaccination. The QALY metric captures both years of 
life lost from premature death, and loss of quality of life 
through morbidity. To value this health loss, we used dis- 
ability weights (DWs), as outlined below. We formally use 
the term QALY DW in this paper's Methods and Results, 
but shorten it to QALY in other sections. 

The two main adaptations were adding vaccine and 
administrative costs per vaccinated boy, and additional 
reductions in HPV infection due to additionally vaccin- 
ating boys. 

Health system costs included both direct intervention 
costs and downstream health system costs incurred/ 
averted. A 3% discount rate applied to costs and quality- 
adjusted life years (QALYs DW ) gained. Currency conver- 
sions were conducted using the OECD purchasing 
power parity (PPP) estimates, to eliminate the differ- 
ences in price levels between countries [21]. In 2011, the 
PPP values were US$1 = NZ$1.48. 

HPV vaccination was modeled as preventing CIN I-III, 
cervical, anal, oropharyngeal and vulval cancers and 



anogenital warts (Figure 1) using rates of all-cause mor- 
tality, excess mortality rates from cancer [22], and inci- 
dence rates for cancer [23] and morbidity states [24]. 
Vaginal and penile cancers were excluded due to their 
small contribution to the HPV16/18-related cancer bur- 
den (<3%). Recurrent respiratory papillomatosis (RRP) 
was excluded due to sparse data. Cervical cancer screen- 
ing programs were assumed to continue in New Zealand, 
but these costs were excluded from our analyses. 

Model input parameters 

Input parameters are shown in Table 1 (HPV prevalence 
reduction and vaccination costs) and Additional file 1: 
Tables SI and S2, and briefly described below. 

Morbidity 

Disability weights (DWs) for each disease state were 
used, with uncertainty, on a scale from 0 (full health) to 
1.0 (death) (Additional file 1: Table SI). Expected popu- 
lation morbidity (i.e., due to disease other than HPV- 
related disease) was allowed for by using the average 
ethnic and age-specific prevalent years of life lived in 
disability from the New Zealand Burden of Disease 
Study [19], limiting the maximum QALYs DW gained with 
increasing age. Consider a non-Maori male aged 50-54 
with oropharyngeal cancer in the remission phase (ex- 
pected DW = 0.248, although actually modeled with un- 
certainty), with an expected background morbidity of 





Cancer clone, i 

• States = Cervical, vulvar, 
oropharygeal and anal 

• In state 5 years before return 
to healthy 




Morbidity clone, j 

• States = CIN I, CIN 1011, warts 

• Temporary state - one year 

• Transitions permitted to other 
morbidity states, with rates as 
from 'Healthy' (i.e. r 4j ) 




Death from 
cancer 



Death from 
other causes 



Figure 1 Stylized Markov model for HPV-related disease states, r, = rates of all-cause mortality from population lifetables, by sex, age, 
ethnicity (Maori, non-Maori) and area deprivation (approximate tertiles), and projected to future. Source: [22]. r 2i = excess mortality rates of death 
from cancer i, by sex, age, ethnicity and deprivation, and by time since diagnosis. Source: [23] r 3i = incidence rates for cancer i, by sex, age, 
ethnicity and deprivation. Source: [24] r 4j - = incidence rates for morbidity states j, by sex and age (and ethnicity for CIN I, CIN ll/lll and anogenital 
warts). Source: [20], 



Table 1 Intervention parameters: vaccination coverage of 12-year olds, reduction in future HPV and intervention costs 



Intervention 



Vaccination coverage 



Beta distribution for 
vaccination coverage 



Reduction in HPV infection for central estimate 
of vaccination coverage only (95% uncertainty interval) 



Females 



Males 



HPV6/11 



HPV16/18 



HPV6/11 



HPV16/18 



Vaccination costs 
(NZ$ 2011; SD as% 
of expected valued 

used for gamma 
distribution) 



Intervention 1G: Girls only program as 


Maori: 56%; assumed SD = 2% 


alpha 


= 344, 


Maori: 75% 


Maori: 49% 


Maori: 75% 


Maori: 47% 


$760 (10%) 


per NZ in 201 1 




beta 


= 271 


(57% to 83%) 


(41% to 59%) 


(55% to 83%) 


(41% to 53%) 






Non-Maori: 45%; assumed 


alpha 


= 278, 


Non-Maori: 67% 


Non-Maori: 41% 


Non-Maori: 66% 


Non-Maori: 37% 


[($11 3 vaccine + $141 




SD = 2% 


beta 


=340 


(48% to 76%) 


(33% to 50%) 


(47% to 74%) 


(32% to 43%) 


administrative) x 3] 


Intervention 2G: Enhanced uptake as per 


73% (no variation by ethnicity 


alpha 


= 56.8, 


81% 


63% 


81% 


61% 


$716 (10%) [($113 


Australia with school-only delivery (girls only) 


or deprivation level); assumed 


beta 


= 21.0 


(64% to 88%) 


(53% to 73%) 


(65% to 88%) 


(53% to 67%) 


vaccine + $ 126 




SD = 5% 














administrative) x 3] 


Intervention 1G + B: Adding boys to 1G 


Maori: 56%; assumed SD = 2% 


alpha 


= 8.14, 


Maori: 77% 


Maori: 67% 


Maori: 78% 


Maori: 73% 


$760 (10%) 






beta 


= 1.86 


(59% to 85%) 


(53% to 79%) 


(58% to 88%) 


(63% to 83%) 






Non-Maori: 45%; assumed 


alpha 


= 8.09, 


Non-Maori: 70% 


Non-Maori: 58% 


Non-Maori: 71% 


Non-Maori: 65% 


[($113 vaccine + $141 




SD = 2% 


beta 


= 1.90 


(50% to 79%) 


(45% to 71%) 


(51% to 80%) 


(54% to 75%) 


administrative) x 3] 


Intervention 2G + B: Adding boys to 2G 


73%; assumed SD = 5% 


alpha 


= 7.84, 


81% 


78% 


82% 


85% 


$716 (10%) 






beta 


= 2.16 


(67% to 89%) 


(65% to 90%) 


(68% to 89%) 


(65% to 96%) 


[($11 3 vaccine + $126 


























administrative) x 3] 
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0.112 [19]; his expected QALYs awarded in that year 
would be (1-0.248) x (1-0.112) = 0.668. 

Incidence and survival 

Cancer incidence rates were those predicted for 2011 
with trends projected into the future based on regres- 
sions on New Zealand Cancer Registry data [25]. There- 
fore, when the model was run without intervention 
effects, the model produced the same disease data as the 
input dataset. Incidence rates for other diseases and the 
proportion of disease due to HPV 16/18 or 6/11 were 
compiled from various sources, including national can- 
cer registration data [24] and screening program infor- 
mation [26]. Australian burden of disease models were 
used to allocate durations for each cancer in diagnosis 
and treatment, remission, pre-terminal and terminal 
states, with attendant DWs sourced from the Global 
Burden of Disease 2010 [27] with modification to the 
New Zealand distribution of cancers [19]. Cancer survi- 
vors were modeled in the cancer state for five cycles ac- 
cumulating QALYs with morbidity adjustment via the 
DWs, then returned to the healthy state. 

Health system cost parameters 

Just as QALYs DW were awarded to each individual as 
they traveled through states, so were health system costs. 
We used routine, linked administrative health data for 
the entire New Zealand population with costs attached, 
as described elsewhere [19]. We assigned health system 
costs by sex and age to the healthy state (see Additional 
file 1: Table S2). The added cost for cancer patients at 
different stages of care (i.e., diagnosis, remission, ter- 
minal) were estimated using gamma regression, as per 
the previous research in the BODE Program for girls- 
only vaccination [20]. The added cost for other disease 
states (CIN I-III and warts) were simple averages. All 
health system costs were measured in 2011 New Zealand 
dollars. 

Interventions 

Effectiveness: vaccination coverage and future reduction in 
HPV prevalence 

The vaccination coverage levels were assumed to be the 
same for both boys and girls for two interventions: (1G and 
1G + B) the current girls' 3-dose coverage level in 12-13 
year olds in New Zealand (45-56%) [28]; and (2G and 2G + 
B) Australia's coverage level of 12-13 year old girls (73%), 
with no catch-up vaccination modeled. We suspect that 
similar coverage is a reasonable assumption for school- 
based vaccination programs, provided that sufficient infor- 
mation is communicated to parents and providers about 
the direct benefits to males of HPV vaccination. We note 
that a recent review found a preference to vaccinate females 



over males among both health care providers and parents 
[29], which could lead to lower coverage for boys than girls. 
However, the review authors noted that in many studies the 
direct benefits to males were not communicated and the 
main reason given for refusal was the lack of perceived dir- 
ect benefit for males. 

The reduction in HPV infections for varying programs 
of girls-only and girls and boys vaccination was esti- 
mated by meta-regressions on outputs from Brisson et 
al's (2011) dynamic Canadian model [13], which allowed 
for changing likelihood of acquiring HPV over time and 
herd immunity effects. This model used gender and 
age-specific sexual behavior characteristics (e.g., partner 
acquisition rates, mixing between age groups) as risk 
factors for HPV infection. Thus, our Markov macro- 
simulation models assumed similar sexual behaviors to 
that in the Canadian model. We considered this gener- 
ally reasonable on the basis of available comparable 
data on age of sexual debut and the epidemiology of 
genital warts. While data on adolescent sexual behavior 
are sparse, age of sexual debut are similar between 
Canada [30] and New Zealand [31]. Likewise, incidence 
of genital warts peak in the same age groups (<25 years 
old) in both countries [32,33]. 

Briefly, we fitted regression models to their output for 
the median, 10 th and 90 th percentile reductions in HPV 
prevalence with vaccine coverage as an independent 
variable for two types of HPV (6/11 and 16/18) for girls- 
only vaccination, doubled the uncertainty range on the 
logistic scale to account for 'structural' uncertainty when 
using the results in New Zealand, and then used these 
median and widened uncertainty intervals to generate 
Beta distribution parameters to sample in the model 
(method details described in an Appendix to the parallel 
study on girls-only vaccination [20]). For the marginal 
impact of boys, we assumed a correlation of 0.5 between 
the HPV prevalence impacts of girls-only vaccination 
and the marginal impact of adding boys, and calibrated 
Beta distributions to achieve the uncertainty reported in 
[13] for the marginal impact of adding boys' vaccination. 
Examples of future long-term HPV reduction for speci- 
fied vaccine coverage levels are shown in Table 1. We 
assumed that the vaccine efficacy was 99% and had a 
duration of 20 years, that the effect of HPV vaccination 
was in a 'steady state' and that vaccine immunogenicity 
was the same in both boys and girls. 

Intervention costs 

The vaccination costs were calculated per fully vaccinated 
girl/boy, based on the annual vaccine cost paid by the Min- 
istry of Health (in 2011), resulting in the vaccine cost per 
dose of NZ$113 (Table 1). The delivery/administration 
costs of three main interventions were NZ$141 or NZ$126 
per dose depending on the method of delivery (i.e., in 
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schools and primary care settings or in schools only). These 
costing data were based on official Ministry of Health data 
which include funding to cover program management 
(a component which is often omitted from 'administration 
costs' of other studies). The vaccination costs were multi- 
plied by three doses, and then assigned for each fully vacci- 
nated member of the cohort (allowing for vaccine 
coverage); incomplete vaccine courses were not considered. 
We used a discount rate of 3% and as for health system 
costs, all intervention costs were measured in 2011 New 
Zealand dollars. 

In scenario analyses, we explored reductions in vaccine 
cost-per-dose at several levels of reduction down to $1 and 
lower administrative costs (NZ$19 per dose). We also con- 
ducted a scenario analysis which removed the herd immun- 
ity cancer reduction benefits for males in the girls-only 
vaccination program (1G). We compared these results with 
the benefits of adding boys to the vaccination program 
(1G + B) and included MSM-attributable warts and can- 
cers in the disease incidence data that populates the 
model. We also performed a threshold analysis to estimate 
the maximum cost per delivered vaccine dose (including 
vaccine and administration costs) which would allow vac- 
cination of boys in addition to girls to be cost-effective 
compared to girls only vaccination. 

Considering uncertainty and performing cost- 
effectiveness analysis 

Monte Carlo simulation was used, with 2,000 draws from 
input parameter distributions. Incremental QALYs DW , costs 
and incremental cost-effectiveness ratios (ICERs) were cal- 
culated for each draw of Monte Carlo simulation. All mod- 
eling and uncertainty analyses were undertaken in TreeAge 
Pro 2012. ICERs were calculated for each intervention in- 
cluding boys (1G + B and 2G + B), compared to the equiva- 
lent intervention for girls-only (1G and 2G) and compared 
to no vaccination program. In line with contextualizing 
ICER results with GDP per capita comparisons [34], we 
made such comparisons for the New Zealand setting. Be- 
cause there is no universally accepted threshold in New 
Zealand for describing interventions as being "cost-effect- 
ive" or not, we relied on the WHO definition and used a 
nominal GDP per capita of NZ$45,000 in 2011 (US 
$29,600) as being such a threshold. Using the GDP per 
capita level is based on the WHO description of interven- 
tions below this value as being 'very cost-effective' (for the 
WPROA Region to which New Zealand belongs [34]). 

Results 

The modeling results indicated that the estimated inter- 
vention costs rose with increasing coverage levels and 
when adding boys to the girls-only programs (Table 2). 
QALYs DW gained increased with higher coverage levels. 
Adding boys to the 2011 girls-only program (assuming 



the same level of coverage was obtained in boys) pro- 
duced a similar number of QALYs DW gained (350) as 
the intensive girls-only program (coverage 73%), but at a 
greater cost and thus was dominated. The vaccination of 
boys at the current coverage level for girls would achieve 
additional health benefits at a cost of NZ$117,500 (95% 
UI: $57,100 to $215,000; US$61,400) per QALY DW gained 
compared to the current girls-only program (1G + B 
compared to 1G). Adding boys to an intensified girls-only 
program was not cost-effective (2G + B compared to 2G; 
NZ$247,000 per QALY DW gained, 95% UI: $119,000 to 
$474,000; US$128,000). 

Females gained more QALYs DW from vaccination than 
boys, even when the marginal change was from girls- 
only to boys' and girls' vaccination (Table 3). For ex- 
ample, the 2G + B interventions (i.e., both girls and boys 
at 73% vaccine coverage) compared to 2G still produced 
more QALYs DW gained for each individual female than 
male (0.0015 vs 0.006). 

Figure 2 shows the cost-effectiveness acceptability 
curves for the three of the four programs (1G + B does 
not appear as it was dominated as shown in Figure 3) 
and no HPV vaccination program. Up to a willingness- 
to-pay of about NZ$17,000, no HPV vaccination is the 
optimal decision, then girls-only as currently imple- 
mented in New Zealand up to NZ$33,000, and from a 
willingness-to-pay of NZ$33,000 to NZ$230,000 an in- 
tensified girls-only program is optimal. Only above a 
willingness-to-pay of NZ$230,000 would vaccination of 
boys be optimal. 

Scenario analyses indicate that regardless of either very 
low vaccine costs or low administrative costs, adding the 
vaccination of boys was not found to be cost-effective 
(Table 4). Increasing coverage in girls (2G) was consist- 
ently more cost-effective than including boys. Applying 
a 0% discount rate to costs and QALYs DW still did not 
lead to the boys programs being cost-effective compared 
with girls-only programs. However, by combining both 
very low cost vaccine (NZ$1) with low administration 
costs, all incremental comparisons including boys 
compared to girls' vaccination became dominant. In a 
threshold analysis, we found that vaccination of boys 
in addition to girls only became cost-effective (at a 
willingness-to-pay threshold of $45,000 per QALY 
gained) when the combined administration and vaccine 
costs were $125 per dose or less (Figure 4), corresponding 
to an estimated maximum cost per vaccinated individual 
of $375. 

We undertook sensitivity analyses to explore which in- 
put parameter uncertainty was driving most of the un- 
certainty in outputs (i.e., net cost, QALYs DW gained and 
the ICER) (see Additional file 1: Figure SI). In Table 4, 
we explored possible underestimation of comparative 
advantage for MSM in the boys' and girls' vaccination 



Table 2 Total population level costs, QALYs gained and ICERs (95% uncertainty intervals) arising from vaccinating 12-year-olds (boys and girls) in New 
Zealand in 2011, for the two interventions each compared to no vaccination program and for incremental comparisons 



Each intervention compared to no HPV vaccination Incremental comparisons 





Intervention 1G: 
Replicating the 
girls-only NZ 
program in 201 1 


Intervention 2G: 
Intensive girls- 
only program, 
school-based 


Intervention 1G + 
B: Adding boys 
to the girls NZ 

program in 201 1 


Intervention 2G + B: 
Adding boys to the 
intensive girls program, 
school-based 


[A] Intervention 2G 
c.f. Intervention 1G 


[B] Intervention 

1G + Bc.f. 
Intervention 1G 


[C] Intervention 
2G + Bc.f. 
Intervention 1G + B 


[D] Intervention 2G + 
B c.f. Intervention 2G 


Cost of 
intervention 
(NZ$; 1,000 s) 


$10,332 
($8,537 - $12,383) 


$14,955 
($11,877 -$18,491) 


$21,157 
($17,482 - $25,360) 


$30,632 
($24,325 - $37,873) 


$4,624 
($829 - $8,656) 


$10,826 
($8,945 - $12,977) 


$8,252 
($544 - $16,561) 


$15,676 
($12,449 - $19,382) 


Net cost (NZ 


$4,644 


$7,326 


$13,610 


$21,474 


$2,683 


$8,966 


$7,864 


$14,147 


$; 1,000 s) 


($2,269 - $7,045) 


($3,873 - $11,126) 


($9,223 - $18,370) 


($14,932 - $28,858) 


($-784 - $6,409) 


($6,643 - $11,406) 


($296 - $15,921) 


($10,588 - $17,975) 


QALYs DW 
gained 


267 
(162-413) 


350 
(218-530) 


350 
(222-529) 


413 

(266-608) 


83 
(48-127) 


83 
(47-134) 


63 
(19-115) 


63 
(33-104) 


ICER* 


$18,800 


$22,300 


$41,100 


$54,600 


$33,500 


$118,000 


$148,000 


$247,000 




($6,500 - $36,700) 


($9,500 - $41,100) 


($20,700 - $70,000) 


($29,900 - $90,400) 


($-10,700 - $88,600) 


($57,100 - $215,000) 


($1,300 - $438,000) 


($11 9,000 -$474,000) 



•ICERs rounded to nearest $100 or nearest $1,000 if > $100,000. Discount rate 3%. 



Table 3 Incremental costs, QALYs gained and ICERs per individual 12-year-old over their whole lives (expected value analysis) 



Baseline 



Each intervention compared to no HPV vaccination 



Incremental comparisons 



Intervention 1G: 
Replicating the girls-only 
NZ program in 2011 



Intervention 2G: 
Intensive girls-only 
program, school-based 



Intervention 1G + B: 
Adding boys to the girls 
NZ program in 201 1 



Intervention 2G + B: Adding 
6oys to the intensive girls 
program, school-based 



[A] Intervention [B] Intervention [D] Intervention 

2Gc.f. IG + Bc.f. 2G + Bc.f. 

Intervention 1G Intervention! G Intervention 2G 



Net cost (NZ$) 



$81 



$129 



Total $43,807 
population 

QALYs™ gained (all individuals regardless of vaccination status) 



0.0045 



Total 26.2830 
population 

Males 26.3533 

Females 26.2092 

ICER* 

Total 
population 

•All ICERs rounded to nearest $100 or nearest $1,000 if > $100,000 



0.0025 
0.0066 

$18,100 



0.0059 



0.0032 
0.0087 



$21 



$235 



0.0059 



0.0033 
0.0085 



$372 

0.0069 

0.0038 
0.0102 

$53,700 



$■'1/ 

0.0014 

0.0007 
0.0021 

$34,000 



$154 

0.0014 

0.0009 
0.0019 

$111,000 



$244 

0.0010 

0.0006 
0.0015 

$234,000 
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- No HPV vaccination 



-Replicating the 
GIRLS ONLY NZ 
program in 2011 
US) 

- Intensive GIRLS 
ONLYprogram, 
school based (2G) 



-Adding BOYS to the 
intensiveGIRLS 
program, school 
based (2G+B) 



SO S10 S20 S30 S40 S50 S60 S70 S80 $90 S100 $110 S120 $130 $140 S150 $160 

Government willingness-to-pay to gain one QALY DW (1000NZ$) 

Figure 2 Multiple cost-effectiveness acceptability curves for three HPV vaccination programs and no HPV vaccination. *when 2G + i 
becomes preferred. 



program (1G + B) compared to girls only (1G). To do 
this, we took an extreme case and removed all of the 
herd immunity cancer reduction benefits (i.e., anal and 
oropharyngeal) for males in the 1G program and com- 
pared this to the benefits of our 'best' 1G + B model (i.e., 
with anal and oropharyngeal male cancer benefits rein- 
troduced. In this analysis the estimated ICER was 
$80,000 per QALY DW gained, which is still far above a 
willingness-to-pay threshold of $45,000. Additionally, a 
Tornado Plot for the ICER for 1G + B compared to 1G 
is shown in Additional file 1: Figure SI. Uncertainty 
about the parameter for marginal HPV reduction from 
vaccinating boys in addition to girls was the biggest 
driver of uncertainty, but even using the 97.5 th percentile 
value of these marginal proportionate reductions in 
HPV (i.e., assuming the greatest incremental benefit for 
adding boys vaccination), the ICER was still greater than 
$75,000 per QALY gained (holding all other parame- 
ters at their expected value). In a cost threshold analysis 



for the most favourable and extreme scenario for boys' 
vaccination (excluding herd immunity benefits related to 
anal and oropharyngeal cancers for males when only fe- 
males vaccinated), we found that the combined cost of 
the vaccine and administration would need to be $167 
per dose or lower (i.e., 34% less than best model ex- 
pected price of $254 and 34% higher than best model's 
cost-effectiveness threshold price of $125 ) for vaccin- 
ation to be considered cost-effective at a willingness-to- 
pay threshold of NZ$45,000/QALY DW (see Additional 
file 1: Figure S2). 

Discussion 

Discussion of main findings and interpretation 

Our finding that HPV vaccination of boys was not cost- 
effective when vaccination coverage in a girls-only pro- 
gram was high (>50%) was consistent with other modeling 
on the incremental cost-effectiveness of adding boys to 
girls-only vaccination programs [1,35]. Specifically, we 




Adding BOYS to the intensive 
GIRLSprogram, school based 



Intensive GIRLS ONLY program, 
school based 



Replicating the GIRLS ONLY NZ 
program in2011 



■ Replicating the GIRLS ONLY NZ 
program in 2011 



IntensiveGIRLS ONLY program, 
school based 



Adding BOYS to the intensive GIRLS 
program, school based 



0 100 200 300 400 500 600 700 800 900 

QALYs DW gained forthe population 

Figure 3 Cost-effectiveness plane for the two girls-only HPV vaccination programs and adding boys to the intensified girls-only 
program compared to no HPV vaccination (bold black lines join average values). 



Table 4 Scenario analyses (expected value analysis; average costs and QALYs gained per individual 12-year-old over their whole lives 



Each intervention compared to no HPV vaccination 



Incremental comparisons 



Interventions 



From Table 3, expected value only analysis 



Vaccine price halved (NZ$56) 



Output 



Net cost 
(NZ$) 

QALYs DW 
gained 

ICER 

Net cost 
(NZ$) 

QALYs DW 
gained 

ICER 

Very low vaccine price ($7.46) = GAVI price ~ US$5) Net cost 

(NZ$) 

QALYs DW 
gained 

ICER 

Net cost 
(NZ$) 

QALYs DW 
gained 

ICER 

Net cost 
(NZ$) 

QALYs DW 
gained 

ICER 

Net cost 
(NZ$) 

QALYs DW 
gained 

ICER 



Intervention 1G: Intervention 2G: Intervention 1G+ Intervention 2G + B: [A] [B] [D] 

Replicating the Intensive GIRLS- B: Adding BOYS to Adding BOYS to the Intervention Intervention Intervention 

GIRLS-ONLY NZ ONLY program, the GIRLS NZ intensive GIRLS 2G c.f. IG + Bc.f. 2G + Bc.f. 

program in 201 1 school-based program in 201 1 program, school- Intervention Intervention^ Intervention 

based 1G 2G 



Highly hypothetical vaccine price $NZ 



Plausibly lower vaccine administration costs 
(NZ$19) 



Hypothetical vaccine price NZ$1 + lower vaccine 
administration costs (NZ$19) 



$81 

0.0045 

$18,100 
$41 

0.0045 

$9,200 
$7 

0.0045 

$1,600 

$3 

0.0045 

$700 
$-4 

0.0045 

Dominant 
$-80 

0.0046 

Dominant 



$129 

0.0059 

$21,900 
$68 

0.0059 

$11,600 
$16 

0.0059 

$2,800 
$10 

0.0059 

$1,700 
$14 

0.0059 

$2,400 
$-103 

0.0059 

Dominant 



$235 

0.0059 

$40,000 
$154 

0.0059 

$26,200 
$84 

0.0059 

$14,300 
$75 

0.0059 

$12,800 
$61 

0.0059 

$10,400 
$-99 

0.0058 

Dominant 



$372 

0.0069 

$53,700 
$248 

0.0069 

$35,800 
$142 

0.0069 

$20,500 
$129 

0.0069 

$18,600 
$138 

0.0069 

$20,000 
$-110 

0.0069 

Dominant 



$47 

0.0014 

$34,000 
$27 

0.0014 

$19,000 
$9 

0.0014 

$6,500 
$7 

0.0014 

$4,900 
$18 

0.0014 

$12,800 
$-22 

0.0013 

Dominant 



$154 

0.0014 

$111,000 
$112 

0.0014 

$81,300 
$76 

0.0014 

$55,300 
$72 

0.0014 

$52,200 
$65 

0.0014 

$47,000 
$-18 

0.0012 

Dominant 



$244 

0.0010 

$234,000 
$180 

0.0010 

$173,000 
$126 

0.0010 

$121,000 
$119 

0.0010 

$115,000 
$124 

0.0010 

$119,000 
$-7 

0.0010 

Dominant 
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Table 4 Scenario analyses (expected value analysis; average costs and QALYs gained per individual 12-year-old over their whole lives (Continued) 



GAVI vaccine price + lower vaccine administration 
costs (NZ$19) 


Net cost 
(NZ$) 


$-77 


$-99 


$-90 


$-94 


$-22 


$-12 


$5 




QALYs DW 
gained 


0.0045 


0.0059 


0.0059 


0.0069 


0.0014 


0.0014 


0.0010 




ICER 


Dominant 


Dominant 


Dominant 


Dominant 


Dominant 


Dominant 


$5,000 


Discount rate 0% 


Net cost 
(NZ$) 


$-28 


$-23 


$80 


$183 


$5 


$108 


$205 




QALYs™ 
gained 


0.0135 


0.0186 


0.0190 


0.0233 


0.0051 


0.0055 


0.0047 




ICER 


Dominant 


Dominant 


$4,200 


$7,900 


$1,000 


$19,400 


$43,900 


Cost and QALYs DW discount rate 6% (double 
baseline) 


Net cost 
(NZ$) 


$123 


$186 


$293 


$443 


$63 


$170 


$257 




QALYs DW 
gained 


0.0025 


0.0031 


0.0030 


0.0035 


0.0006 


0.0006 


0.0004 




ICER 


$50,100 


$59,900 


$96,500 


$127,000 


$97,000 


$294,000 


$695,000 


Excluding unrelated health system costs t 


Net cost 
(NZ$) 


$73 


$117 


$222 


$356 


$44 


$150 


$240 




QALYs™ 
gained 


0.0045 


0.0059 


0.0059 


0.0069 


0.0014 


0.0014 


0.0010 




ICER 


$16,200 


$19,800 


$37,900 


$51,500 


$31,500 


$109,000 


$231,000 


Excluding disease DWs (i.e., no morbidity impacts 
of HPV-related disease) A 


Net cost 
(NZ$) 


$81 


$129 


$235 


$372 


$47 


$154 


$244 




QALYs™ 
gained 


0.001 1 


0.0016 


0.0017 


0.0022 


0.0006 


0.0007 


0.0006 




ICER 


$76,500 


$79,800 


$137,000 


$166,000 


$86,200 


$233,000 


$383,000 


Excluding both background morbidity and disease 
DWs (i.e., life years gained analysis, ignoring 
morbidity) 


Net cost 
(NZ$) 

QALYs™ 
gained 


$81 
0.0015 


$129 
0.0023 


$235 
0.0024 


$372 
0.0031 


$47 
0.0008 


$154 
0.0009 


$244 
0.0009 




ICER 


$53,100 


$56,300 


$96,700 


$ 1 1 9,000 


$62,700 


c 1 " 1 ~i 1 c\c\r\ 

$1 71 ,000 


$284,000 


Excluding herd immunity benefits related to anal 
and oropharyngeal cancers for males when only 
females vaccinated: 1G (i.e., considering 
underestimation of benefits to MSM in 1 G + B) 


Net cost 
(NZ$) 

QALYs™ 
gained 

ICER 












$144 
0.0018 
$80,000 





t That is ignoring the health costs from diseases other than those specifically modeled, which increase net costs as living longer is associated with costs from (other) future disease and disability. 

A That is the DWs for cancers, CIN and anogenital warts states are all set to zero - but the background morbidity is retained. The health gain realized from HPV vaccination is therefore only from preventing premature 

death from cancer. NOTE: all items in bolded font are cost-saving. 
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combined vaccine cost (per dose) + vaccine administration cost (per dose) 

Figure 4 Cost threshold analysis for the combined vaccine + administration costs per dose for the best model adding boys to the 
girls-only program. Incremental cost-effectiveness ratio of adding boys to the current girls-only program (1 G + B), compared to the current 
girls-only program (1G), as a function of cost per dose delivered (including vaccine and administration costs). 



found that providing vaccination of boys at the current 
coverage level for girls would cost US$61,400 per QALY 
gained (NZ$118,000, 95% UI: $57,100 to $215,000) com- 
pared to the current girls-only program. For comparison 
to other international studies, it is useful to use US dollars. 
In the base case, we assumed the current New Zealand 
vaccine cost of US$59 (NZ$113) per dose and administra- 
tive costs of US$73 (NZ$141) per dose. By comparison, 
US models (which do not generally assume vaccine is de- 
livered as a publicly-funded health service) assumed vac- 
cine costs (in 2011 USD) of US$101-135 per dose [35,36] 
and US$61 administration costs per dose [35]. Those same 
studies, when comparing the addition of boys to girls-only 
vaccination programs, and including all HPV-related dis- 
eases and similar vaccine efficacy and duration to our study, 
were found to be more cost-effective than our study, ran- 
ging from US$26,000 [36] to $41,000 [35] per QALY for 
coverages under 50% and $62,000/QALY for coverages up 
to 70% [37]. While direct comparisons between cost- 
effectiveness analyses are difficult, the observed differences 
in cost-effectiveness are most likely due to varying disutility 
assigned to genital warts and CIN states (less in our model 
than in the US studies, see Additional file 1: Table SI; and 
uncertainty analyses in our parallel girls-only vaccination 
paper demonstrated that disutility assigned to these states 
was a major driver of uncertainty in the final ICER [20]). 
Also, the inclusion of future health system costs in our 
model will slightly lessen cost-effectiveness (scenario ana- 
lyses about excluding unrelated health system costs show 
little impact, see Table 4) and our use of a cohort (rather 
than a population-wide) model may have influence. Our 



study also found that vaccination of boys only became cost- 
effective under the conditions of both an extremely low 
vaccine price (NZ$1 per dose) and with very low adminis- 
tration costs (NZ$19 per dose), up to a maximum total cost 
of NZ$125 per dose delivered. However, even at a lower 
cost per dose delivered, because a more intensive female- 
only program is equally effective and less costly than adding 
boys to the current program, increasing coverage in girls 
would generally remain a preferable strategy if this could be 
achieved. 

Study strengths and limitations 

A strength of this study is its potential to fill a gap in 
the knowledge base for New Zealand policy makers who 
may be considering what next after the relatively suc- 
cessful implementation of a girls-only HPV program. 
More broadly it adds to the relatively small number of 
studies that have addressed the cost-effectiveness of vac- 
cinating boys in a publicly funded system. 

Nevertheless, a limitation is the lack of local data to 
build a dynamic HPV infection model and thus, our reli- 
ance on HPV reduction results from a Canadian dy- 
namic model. Thus we implicitly assumed that sexual 
behavior in New Zealand and Canada are broadly similar 
for reasons outlined in the Methods section. This should 
not be overly problematic if vaccine coverage rates are 
not correlated with level of sexual behavior or factors 
which influence choice of sexual partner [38]. Further- 
more, refined and improved HPV modeling specific to 
New Zealand would probably not alter our conclusion 
that vaccination of boys is not cost-effective using a NZ 
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$45,000 per QALY threshold (see Additional file 1: Figure 
SI). Rather, a reduction in vaccine cost - perhaps plaus- 
ible in the future - is more likely to influence whether 
vaccination of boys is cost-effective in New Zealand (see 
Table 4 and Additional file 1: Figure SI). That is, uncer- 
tainty in applying Brisson et al. outputs (based on their 
model assumptions, Canadian sexual contact patterns, 
etc.) to the New Zealand situation - whilst important - 
does not appear to be enough to alter the general con- 
clusion that vaccinating boys in New Zealand is not 
cost-effective (in the absence of large vaccination price 
reductions). Another related issue was our use of a 
'steady state' of HPV reduction in our population model. 
Our model estimates likely health impacts, costs and 
cost-effectiveness for cohorts of 12-year-olds one to 
three decades into the future after the first cohort is 
vaccinated. This is a robust baseline model for the fol- 
lowing reasons. First even for the first cohort vacci- 
nated, they will still receive the benefits of direct 
immunity (i.e., the majority of the benefit from HPV 
16/18 reduction, as herd effects are smaller for these 
HPV types, and also much of benefit from HPV 6/11 
reduction, which has greater herd immunity [13]). The 
first cohort vaccinated will also receive the benefit of 
herd immunity from vaccination of the cohort's immedi- 
ate age contemporaries and subsequent vaccination of 
younger cohorts and additionally some herd immunity 
from older cohorts included in the catch-up program. 
Girls up to nine years older than the modeled cohort (i.e., 
born in 1990 or later) were offered vaccination, with 
achieved three-dose coverage in the range 37-54% [39]. 
Last, there is a 'lead time' benefit. For example, those vac- 
cinated at age 12 years likely have a modal age of coitarche 
of 15-18 years [30], and a period of maximum exposure 
to HPV, due to multiple sexual partners, from age 15 to 
30 years. This cohort will start to benefit from herd 
immunity as previous modeling studies e.g., [15] and now 
observed data from several countries [40] suggest that 
HPV prevalence is likely to drop rapidly after the intro- 
duction of HPV vaccination. 

We did not include any costs associated with starting-up 
a boys' vaccination program, as these would likely be com- 
paratively small when considered over the longer term and 
because including boys is extending the existing girls-only 
program, rather than a new program. (Scenario analyses 
available from the authors on request confirm this). We 
also did not model different coverage rates for boys and 
girls, given we expected minimal differences can be 
achieved, particularly with school-based vaccination pro- 
grams. We did not include the health benefits of cross- 
protection of the quadrivalent vaccine against other HPV 
strains which cause disease; such analyses would likely have 
only a minor positive impact on QALYs gained and there- 
fore only modesdy affect cost-effectiveness [41]. Our 



modeling does not separately model MSM, although we 
did conduct a scenario analysis which removed the herd 
immunity cancer reduction benefits for males in the girls - 
only vaccination program (1G). We compared these results 
with the benefits of adding boys to the vaccination program 
(1G + B) and included MSM-attributable warts and cancers 
in the disease incidence data that populates the model. 
Should a targeted program be able to successfully deliver 
vaccination to MSM at a young age (e.g., in primary care 
settings), it seems highly likely that this would be cost- 
effective [17]. 

Our costing data for vaccination delivery were based on 
official Ministry of Health data which include funding to 
cover program management (a component which does not 
seem to typically be included in the 'administration costs' of 
other studies). We recognize that this cost and relatively 
high vaccine costs do not account for future plausible de- 
velopments (e.g., in changes in delivery (see below) or de- 
clines in vaccine prices). The latter is particularly relevant 
to New Zealand, which has a single government-owned 
agency (Pharmac) that purchases pharmaceuticals for the 
whole country and has recendy taken over national-level 
vaccine purchases (from the Ministry of Health). This de- 
velopment could result in substantial reductions in vaccine 
prices in future purchase arrangements. 

Research implications 

The cost-effectiveness results were sensitive to vaccine and 
administration costs, suggesting an analysis of a vaccination 
program with only two required doses would be useful in 
future research. However, if the efficacy of two doses were 
similar to that of three doses, vaccination of boys would still 
not be cost-effective based on our findings from our 'best' 
model (i.e., that with current prices), unless the total cost 
per vaccinated individual was less than NZ$375 (based on 
our threshold analysis). For example, for incremental com- 
parison B in Table 2 (1G + B c.f.lG) the cost of the inter- 
vention (first row) would decrease by a third or $3610, and 
the net incremental cost would therefore reduce by 40% 
from $8,996 to $5390. Hence the ICER would also reduce 
by 40% to about $70,400 per QALY gained. 

If new evidence of lower vaccine bulk prices tendered by 
developed countries becomes available, future modeling 
may be worthwhile as it is likely to suggest improvements 
in cost-effectiveness (lower ICERs). Nevertheless, from our 
analyses, the vaccine price would have to be substantially 
less than the NZ$113 per dose assumed here to include 
boys in any vaccination program, and the overall costs of 
delivering a dose would have to be less than NZ$125, or 
less than an overall cost per vaccinated individual of NZ 
$375. Countries with other school-based vaccination pro- 
grams (e.g., the DTP booster given to 11-year-olds as per 
the New Zealand schedule) could also explore the adminis- 
trative cost savings by providing dual vaccination at this 
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one service. Such combinations of 'piggy-backing' of ad- 
ministration cost reductions along with reductions in vac- 
cine price appear, in our modeling, to be the major way 
that vaccination of boys could start to become cost- 
effective in the current New Zealand setting. 

Possible policy implications 

Given the findings of this modeling, policy makers in set- 
tings like New Zealand (with relatively low HPV coverage 
for girls) should probably focus more on improving HPV 
vaccination for girls than adding HPV vaccination for boys. 
Indeed, they should probably set decision review dates 
around HPV vaccination for boys out into the medium 
term or at least until vaccine prices drop substantially. 

If policy makers are under public pressure to provide vac- 
cination for boys then they should ideally focus on ways to 
reduce the overall cost per vaccinated individual, as this will 
increase the cost-effectiveness of adding boys to the pro- 
gram, for example via research around cost-reduction mea- 
sures (e.g., how to reduce delivery costs and also how to 
obtain lower cost vaccine as detailed in the section above). 
They could also reassure the public that the initial most lo- 
gical goal of achieving higher HPV vaccination coverage for 
girls will actually produce substantial spillover benefits via 
herd immunity for boys. 

Conclusions 

These modeling results suggest that in countries like New 
Zealand, the health sector would get the best value-for- 
money by further improving HPV vaccination coverage for 
girls, rather than adding in the vaccination of boys. Never- 
theless, if very low vaccine and program administration 
costs are achieved in the future, vaccination of school boys 
may become cost-effective. 
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